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C^ ' Abstract 



The FARIMA models, which have long-range-dependence (LRD), are widely used in many areas. 
Through deriving a precise characterisation of the spectrum, autocovariance function, and variance time 
function, we show that this family is very atypical among LRD processes, being extremely close to the 
fractional Gaussian noise in a precise sense. Furthermore, we show that this closeness property is not robust 
to additive noise. We argue that the use of FARIMA, and more generally fractionally differenced time series, 

Qi^ ' should be reassessed in some contexts, in particular when convergence rate under rescaling is important and 

•^r . noise is expected. 

C^ , Keywords: FARIMA, fractionally differenced process, self-similarity, fGn, long-range dependence. Hurst 

^ ' parameter 

> : 1 Introduction 

O 

, ■ For a wide variety of purposes including data modelling, synthetic data generation, and the testing of statistical 

\^ \ estimators, tractable and flexible time series models are indispensible. The well known AutoRegressive Moving 

Average (ARMA) family, for example, allows for a wide variety of short range correlation structures, and has 
(<— ^ I been used in many contexts. 

^N I Long-Rang e Dependence (LRD), or long memory, in stationary time series is a phenomenon of great 



tz. — ^ n 



importan ce Taqqu (20 02|). The Frac t ional AutoRegressive Integrated Moving Average (FARIMA) models 



HoskingI tl981.) : .Granger and Joveuxl (Il980l) are very widely used as a class which inherits the advantages 



of ARMA, while exhibiting LRD with tunable Hurst parameter, the scaling parameter of L RD. They h ave in 



particular been widely used to parsimoniously model data sets exhibiting LRD (for example lllowl (120001) '). and 



Cd ■ more importantly for our purposes here, they have also been em ployed to make quantitat i ve ass essments of the 



behaviour of stochastic systems in the face of LRD (for example lBarbe and McCormickl ( 120101) ) 



A good exa mple is in relation t o estimators of the Hurst parameter H. FA.RIMA models have been used 



(for example iTaqqu et al.l (Il995h : iTaqqu and Teverovskvl (119971) : lAbrv et al.l (l2003h ) in order to evaluate the 



performance of H estimators under circumstances more challenging than that of the canonical fractional 
Gaussian Noise (fGn), in particular to assess small sample size performance using Monte Carlo simulation. 
Although explicit claims of the generality of the FARIMA family are not made, implicitly it is taken to be a 
typical class of LRD time series in some sense, and so results obtained using it are taken to be representative 
for LRD inputs in general. 

In fact, no parametric model can be truly typical. However, for a model class to be useful it should be 
representative for the purposes to which it is commonly put. In this paper, we show that FARIMA time series. 



and more gen erally time series whose LRD scaling derives directly from fractional differencing such as the 



FEXP models iRobinsonI (119941) . are far from typical when it comes to their LRD character, the very quality 
for which they were first introduced. In a sense we make precise, out of all possible LRD time series, their 
LRD behaviour is in fact 'as close as possible' to that of fGn. A key technical consequence is ultra-rapid 
convergence to fGn under the rescaling operation of aggregation. The implications for the role of the family is 
strong, namely that, in regards to LRD behaviour, FARIMA offers no meaningful diversity beyond fGn. A second 
key consequence is that the addition of additive noise (of almost any kind) pushes a FARIMA process out of 
the immediate neighbourhood of fGn, changing the convergence rate. In other words FARIMA is structurally 
unstable in this sense or brittle, and is therefore unsuited for use as a class of LRD time series representing 
real-world signals. 



This w ork arose out of our prior study of (second-order) self -similarity of stationary time-series iGefferth et al. 



(I2003h . which highlighted the benefits of the variance time function (VTF) formulation of the autocovariance 
structure, over the more commonly used autocovariance function (ACVF) formulation. Using the VTF, 
questions of process convergence under rescaling to exactly (second-order) self-similar limits can often be 
more simply stated and studied. 

The paper is structured as follows. After Section |2] on background material. Section |3] establishes the main 
results. It begins by characterising a link between a fractionally differenced process and fGn in the spectral 
domain. Using it, we prove that related Fourier coefficients in the time domain decay extremely quickly, and 
then show that as a result the VTFs of the fractionally differenced process and fGn are extremely close. We 
then explain why this behaviour is so atypical, and how it results in fast convergence to fGn. Finally we go 
on to provide distinct direct proofs of closely related results for the ACVF and spectral formulation which are 
of independent interest. In particular, they lead to additional closeness results for the spectrum. In Section |5] 
we explain why fractional processes are not robust to the addition of additive noise, even noise of particularly 
non-intrusive character We also provide numerical illustrations of this brittleness, and of the fast convergence 
to fGn of FARIMA processes. We conclude and discuss possible implications of our findings in Section|6] 



Very e arly versions of this work appear in the 2002 workshop papers IGefferth et al.l(l2002h : IGefferth et al. Nov 



(120021) . 



2 Background 

Let {X{t), t E Z} denote a discrete time second-order stationary stochastic process. The mean i^i and variance 
V > of such a process are independent of t, and the autocovariance function (ACVF), j{k) := E[{X{t) — 
fi){X{t + fc) — n)], depends only on the lag k, k E Z, and 'j{k) ~ j{—k). 

A description of the autovariance structure which is entirely equivalent to 7 is the variance time function, 

defined as uj{n) ~ {I'j){n) := X]fc=o 12i=-k t(*) " = 1, 2, 3, . . ., where I denotes the double integration 
operator acting on sequences. Its normalised form, the correlation time function (CTF), is just (f>{n) = 
uj{n)/uj{l) = Lj{n)/V. In terms of the original process, Lj{n) is just the variance of the sum X^tLi -^i^)- 
It is convenient to symmetrically extend u! and (/) to Z by setting uj{n) := cl'(— n) for n < and uj{0) — 0. 

2.1 LRD, Second-Order Self- Similarity, and Comparing to fGn 

There are a number of definitions of long-range dependence, all of which encapsulate the idea of slow decay of 
correlations over time. Common definitions include power-law tail decay of the ACVF 7(n) ^ c^n^^"'^, or 

power-law diverge nce of the spec tral density at the origin f[x) ^~ c/ |x|^^^^^^^ for related constants c^ and 



Cf (see for example iTaqquI (12002^ . Section 4). 

The well known fractional Gaussian noise (fGn) family, parameterised by the Hurst parameter H £ [0,1] and 
variance V > 0, has Ld{m,) = uj'^ ^{m) :— Vrri^^ (to lighten notation we sometimes write lo*^^ or simply w*). 
It has long memory if and only if H E (1/2, 1]. 



In this paper we compare against fGn with if e (1/2, 1] as it plays a special role among among LRD processes; 
that of being a family of second-order self-similar time serie^j. To understand how this comparison can be 
made, we must define self-similarity and related notions. 

Self-similarity relates to invariance with respect to a rescaling operation. In the present context, the time 
rescaling is provided by what is commonly called aggregation. For a fixed m > 1, the aggregation of level m 
of the original process X is the process X'™^ defined as 



X^"'Ht) := 3 y. X{j) 






The 7, to, (j) functions and the variance of t he m-aggregated proc ess will be denoted by 7*^™-', u)^™\ 4>^"^^ and 



V*^™^ respectively. It is not difficult to show lOefferth et al.l(l2003b that 



^M(,) = i^^ V(") = ^. (1) 

To seek invariance, the time rescaling must be accompanied by a compensating amplitude rescaling. This 
is performed naturally by dividing by V ''"■', which amounts to examining the effect of aggregation on the 
correlation structure. Combining the time and amplitude rescalings yields the correlation renormalisation 

^W(„) = 4^ = ^. (2) 

<p[rn} u)[m) 

We can now define second-order self-similarity as the fixed points of this operator 

Definition 1. A process is second-order self-similar iff cf)^™'^ = (j), for all m = 1,2,3,.... 

It is easy to see that fGn, which has 4){m) = (j)*^^ (m) := iri^^ , satisfies this definition for all H E [0, 1]. 

Given a fixed point 0^(?i), we define its domain of attraction (DoA) to be those time series which converge 
to it pointwise under the action of (|2]i. This definition is very general, in particular it includes processes whose 
VTF's have divergent slowly varying prefactors, as these cancel following normalization (see Section [33T l. It 
provi des a natural way to d efine LRD which subsumes and generalises most other definitions including those 



above lGefferth et al.l (120031) : a time series is long-range dependent if and only if it is in the domain of attraction 



of (j)*u{n) for some H G (0.5, 1]. 

With the above definitions the DoA are revealed as the natural way to partition the space of all LRD processes, 
namely into sets of processes each corresponding to the same unique normalized fGn fixed point. Since all 
processes within a DoA converge to the same fixed point, their asymptotic structure can be meaningfully 
compared both against each other and to the fixed point itself. Alternatively if two processes were in different 
DoA's then they cannot be close asymptotically as they would converge to different processes. Section 13.21 
provides a precise characterisation of the closeness of a fractionally differenced process to its corresponding 
fixed point, and its associated fast convergence under renormalization. 

Within a given DoA, one can further partition processes according to some measure of distance from the 
common fixed point. Section [33] establishes such a notion, enabling a comparison of this closeness to that of 
other members of the DoA to be made. 

2.2 Fractionally Differenced Processes and FARIMA 

Let B denote the backshift operator The fractional differencing operator of order d> —1 is given by 

oo 

(1 - BY := 5]r(j - d)/T{-d)T{j + l)B=. 



' U ntil recently, fGn was considered to be the only such family. A second (and final) family was discovered recently iGefferth et all 
<2004h. 



Let {Y{t),t e Z} be a second-order stationary stochastic process. Assuming H G (0, 1) the process 

X:=(l-i3)-(^-i/2)r 
is called a fractionally differenced process with differencing parameter H — 1/2 driven by Y. 



If h is the spectral density of Y then X has spectral density (IBrockwell and DavisI (Il991h . Thm. 4. 10. 1) 

/h(x) =/i(2;)|l-e2'^"p^^^"^' =/i(x)|2sin7r.T|"(2ff-i)^ ^e [-1/2,1/2]. 

In this paper we assume that Y is short-range dependent, and in particular that h satisfies: 

• h{x) > and is continuous for all x G [—1/2, 1/2] (and is therefore bounded); 

9 his three times continuously differentiable on (—1/2, 1/2) (and is therefore in C^). 

Under such conditions, the ACVF of X exists and satisfies ^H{n) 



(3) 



c^n^^ ^ for some constant c^ 



(IBrockwell and DavisI (1199 ll) . Thm. 13.2.2). Hence, when H e (1/2, 1) the process X is LRD with Hurst 
parameter H. 



An important example of a fractionally differenced process is the FARIMA class iHoskin^ (119811) where h 
is the spectral density of a causal invertible ARM A model. This fam ily includes the ARMA family as th e 
specia l case H = 1/2. Another class is the class of FEXP-models (e.g. lBloomfieldl(ll973b : lRobinsonl(ll994l) : 
BeranI (Il993b ) which comes from taking the logarithm of /i to be a trigonometric polynomial, i.e. log h{x) = 
9i cos a; + 02 cos(2a;) + • • • + 0q-i cos(((j — l)a;) for real coefficients. Both FARIMA and FEXP models 
are widely used in statistical applications since, in addition to exhibiting LRD, they both enable modelling of 
arbitrary short-range correlation structures. 



2.3 Normalizing a Fractionally Differenced Process to its fGn Limit 

To identify the fGn fixed point of a fractionally differenced time series only the value of H need be determined. 
When aggregating an unnormalised fractionally differenced time series however, to identify the corresponding 
limiting fGn time series we must in additional know the correct variance V. The purpose of this section is to 
define notation to make this simple and along the way to provide useful expressions for the spectra of these 
processes. 

The ACVF, VTF, and spectral densi ty corresponding to the fixed p oint are denoted 7|j, cjj^, and /^, 
respectively. The latter is given by (see lSamorodnitskv and Taqquld 19941) ') 



fU^) 



oo 



c}7r-^{27rf"+^sm\7Tx) ^ |27rj + 2^x|-(2^+i 



j = -oo 



(4) 



c;|x|-(2«-i), X £[-1/2,1/2], 



where cJ = )/^(27r)^ '^^C{H) > is the prefactor of the power-law at the origin, and C{H) = 
TT~^ Hr{2H) sin(iJ7r) (see lSamorodnitskv and Taqquld 19941) . pp 333-4, but note that the change to normalised 
frequency multiplies /jj by 27r, and c*f by (27r)^~^^). 

We denote by jh, ^h and fn the ACVF, VTF and spectral density of a fractional process with Hurst parameter 

H e (1/2, 1). In view of (O, the latter is given by 

2H-1 hyx) 



Ih{x) ~ /i(a;)|2sin7ra:;| 



-(2H-1) 



Cf{2lTY 



KO) 



|2sin7rx| 



-{2H-1) 



(5) 



-{2H-1) 



cf\x\ — -, X £[-1/2,1/2], 

where Cf = (27r)^^^^/i(0) > 0. In the case of a pure fractionally differenced process, such as 
FARIMA(0, d, 0), h{x) ~ h{0) — 2tt, and c/ = (27r)^~^^ (note again the changes related to normahsed 
frequency, in particular the factor of 27r is built into /i(0)). 

To conclude, the particular fGn to which the fractionally differenced process will converge under renormalisa- 
tion is the one such that ci = Cf. >From this, the value of V can be obtained using the expressions for cJ and 
Cf above, if needed. 



2.4 Regularity and Other Notations 

Denote for a > by A„ the normed space of uniformly a-Holder continuous functions on [—1/2, 1/2], 

A„ := {ip: [-1/2, 1/2] ^ R : ||^||a„ < (»}, 
where || • J|a„ is the a-Holdernorm 

lkl|A„ := sup \if{x)-ip{y)\\x-y\^". 

x,y&[-l/2,l/2] 

Hence Aq, 3 A^ whenever a < /3. The space A^ is closed under pointwise multiplication, addition, and 
composition with functions in Ai. In particular, the subset of Aq, whose members are bounded away from zero 
is closed under reciprocation (i.e. if g G A^, and g is bounded away from zero, then so is 1/g). Observe that 
ip G Ai whenever ip' exists and is bounded. Functions in Aq. are absolutely continuous. 

The linear space of functions of bounded variation on [—1/2, 1/2], denoted V, is defined by 

Y ■.= {ip: [-1/2, 1/2] -^ R : ||^||v < oo}, 
where ]| • ||v is the total variation norm 



sup I '^\ip{xi) - ip{xi-i)\ : P = {a;o,a;i,---a;«}is apartitionof [-1/2,1/2]|. 

4=1 

V is also closed under pointwise multiplication and addition (Apostoll (119741) . Thm. 6.9), and reciprocation of 



4=1 



those functions in V bounded away from zero (lApostoll (119741) . Thm. 6.10 ). Any different iable function with 



bounded derivative on (-1/2, 1/2) is of bounded variation on [-1/2, 1/2] (lApostoll d 1974 . Thm. 6.6) 
We shall use the notation • for convolution of sequences. For sequences a and b 

oo 

{a-kb)„= 2. o,jbn-j7 n S Z. 

j=-oo 

The convolution is said to exist if the infinite sum converges for all n. When needed for clarity, we also use 

{a-k h){n) to denote {a-kb)n- 

Throughout, by smooth function we mean one in C°°. 

3 Fractionally Differenced Processes are Not Typical LRD Processes 

The goal of this section is to establish our main results, rigorous characterisations of the closeness of the 
asymptotic covariance structure of a fractionally differenced process to that of fGn. 

Our approach is simple and can be described as follows. We begin in the spectral domain where the relationship 
between the processes can be simply stated through a function g by defining 

fH{x) = rH{^)gix). (6) 

The simple closed form of the spectra (|4) and (|5) allow g to be explicitly written. We study the properties 
of g, obtaining a characterisation of the closeness of the processes in the spectral domain (Theorem [T]i. This 
leads to a convolution formulation -fH = Jh * G in the time domain, where G is the Fourier Series of g, and 
thereby to a similar relationship for the VTFs, where the fast decay of the Fourier coefficients can be used 
to characterise the closeness (Theorem|2}. The VTF result then allows the closeness within the DoA and the 
convergence speed to be easily established (Theorem |3). Finally we also provide direct closeness results for 
the ACVF (Theoremgli. 



3.1 Closeness of the Spectrum 



We are ultimately interested in characterising the closeness of the covariance structure of a fractionally 
differenced process to that of its fGn fixed point at large lags. The rate of decay of the sequence of Fourier 
coefficients of a function is well known to be closely connected to its smoothness properties. It is, therefore, 
unsurprising that a notion of closeness in the spectral domain can take the form of statements about smoothness 
of the function g in (|6]l. 

The following spectral closeness result is the crucial basis for both the VTF and ACVF results to come. 

Theorem 1. Asswne that H G [1/2, 1) and define g{x) := fH{x)/f^{x), x =/= and g{Q) := livux^o g{x). 
Then g{Q) = Cf/dt = h{Q) / {2'kV C {H)) and g satisfies the following over [—1/2, 1/2].- 

(i) g is even, continuous, positive, bounded, and L^, p > 0; 

(ii) g is twice differentiable, and smooth away from x = 0; 

(iii) g" e A2H-1 n V, but g" ^ A;^' for f3' > 2H - 1; 

(iv) g admits a Fourier series with coefficients {Gj} such that X^^-cxs J^l^jl ^ '^ '^^'^ ^n = 0{n^^). 



In particular X]7=-oo l^jl "^ °° '^"'^ '^j=-oo J°'\^j\ < 00 /or 1 < a < 2. 



Proof. Unless otherwise specified, we consider the domain x € [—1/2, 1/2]. 



First, since fnix) 



a;->0 



c;|a;|-(2H-i)and/^(.T) 



x-i-O 



c/l 



-{2H-1 



\ g{0) := lim^;^og{x) = Cf/c 



The proof of (i) is straightforward. For completeness, details are provided in the appendix. 
To prove the smoothness properties (ii) and (iii), we first establish those of g defined as 

-2ff+l h{x) 



9{x) 



CfTT 

cjh{0) 'J{xj 
sin(7ra;) 2ff+i 



|a(x)| 



2H+1 



+ I sin(7ra;)| 
\b{x)\^"+^cix) 



2H+1 V^ 
J — — oc 



FJ 



-i2H+l) 



(7) 
(8) 
(9) 



It is not difficult to show (see the appendix for details) that g is smooth everywhere except at the origin where 
its smoothness is controlled by that of |6|^^+^, which we now study. 

Let /3 — 2H — 1. Since b is smooth and f3 e (0, 1), |fe|'^+^ is twice differentiable at the origin. The smoothness 
of its second derivative is controlled by (&')^|&|'^, which, since 6 G Ai and a; i-^. |a:;|'3 is in A^, is also in A^ 
by the multiplicative and compositional closure properties of A^. It follows that g" exists and is in A^. Since 

however x 1— >■ |a;|'^ is not in A^/ for any /3' > /?, and moreover b{x) ^ nx and 6'(0) 7^ 0, g" is not in A/3/ for 

any /?' > /3. 

Since smooth functions are in V, by similar arguments using the closure properties of V, we have g" e V if 
|6|^ € V. The latter holds since it is easy to see that |&|'^ is monotone (with total variation 2). 

We have shown that g" exists and is in A2H-1 H V, but not in Api for any f3' > 2H — 1. We now prove the same 
for g using (Q. It suffices to consider 1/g since h'" exists. Since g is bounded away from zero, (ii) follows 
since {1/g)" = 2{g')^/g^ — g" /g^ clearly exists, and is smooth away from the origin. Now consider (iii). 
It follows from the last expression and the fact that g > that {1/g)" and hence 9" are in V and h.2H-i by 
applying the respective closure properties. Finally, since l/g^(0) 7^ 0, the smoothness of {1/g)" is controlled 
by that of g" and so {1/g)" ^ Api for any /?' > 2H — 1. This completes the proof of (iii). 

We now prove (iv). Since each of g, g', and g" ar e continuous and b ounded, the Fourier series for each 
exists and are related by term by term differentiation (IChampenevi i 1 9901) . Thm. 15.19). In particular ofx' 

J2'jL-oo GjC^^"^^^, and we can write g"{x) = — 47r^ ^° 



j^Gje^"-''^. Now Zvgmund lZvgmundl (12002ft. 



Thm. VI. 3. 6 states that the Fourier Series of a function in A^ n V for some /3 > converges absolutely. 
This applies to g" and proves that ^°iL-(x,P\Gj\ < 00 as claimed. Finally, since g" e V, the magnitude 



of its Fourier coefficients decay as 0(|j| ^) (Zvamund IZvgmundl (l2002h . Thm. II.4.12), proving that Gj — 

o{r^). o 



The result suggests that fractionally differenced processes are not typical; for a general LRD process, only 
boundedness of g at the origin would be automatic. In contrast, the present g is a very well behaved function. 
A plot of g is provided in Figure [1] which shows its flatness at the origin (it also suggests that g is monotone 
increasing over [0, 1/2], though this plays no role in what follows). Here we have set c/ = cf, so that its value 
at the origin is just 1. It is interesting to note that since g is positive, even, and square integrable, it is the 
spectral density of some second order time series. 
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Figure 1: The function g{x) = fH{x)/f'^{x) and its first two derivatives in the canonical case of a pure 
fractionally differenced process (FARIMAOdO) with H = 0.8 and c/ = cf. 



3.2 Closeness of the VTF 



The first step in elucidating the relationship between ujh and uj'^ is to confirm that the relationship ///(a;) = 
f^{x)g{x) between the spectral densities translates to the expected convolution relationship ^h = 1*h * G 
between the ACVFs. It is straightforward to confirm that, thanks to the nice behaviour of g and G detailed in 
Theorem[ri this is indeed the case. 

Lemma 1. The auto-covariance functions jh <^nd 7^^ are related through the convolution 'Jh = 7jj * G. 
For completeness a proof is given in the appendix. 

Since ujh = T-Ih, it is tempting to seek a relationship of the form uh = G -k uj*^ through taking the 'double 
integral' of 7/f = G • 7]^. However, since LLi*j^{m) = Viv?^ diverges with m, this is not necessarily well 
defined. The following lemma provides a sufficient condition for the existence of such a convolution, as well 
as some of its important properties which will be crucial in what follows. 

Lemma 2. Assume 1 < a < 2 and let a = {|n|",n G Z}. Let h be a symmetric sequence satisfying 
X)?li i"l^il < °^- Then Sb — TliT=-oo ^3 and the symmetric sequence c ~ a-kbexist, and{cn — Sban) — >■ 0. 



This result is proved in the appendix. The proof of the last part is based on the monotonicity of a function 
which generalises 7^^ to two parameters (see Lemma Al in the appendix). 

Corollary 1. The convolution G * uj^ exists for H G (1/2, 1). 

Proof Set 6 = G in Lemma|2] The condition on h holds since X^jli j"|G'j| < X]^i .^^I'-^il which is finite 
from Theorem[T] The result then following immediately by identifying a with 2H and a with < 



'H- 



u 



The following lemma shows that, if existence is granted, taking the 'double integral' of a convolution is 
straightforward, provided a double counting issue at the origin is allowed for. 



Lemma 3. Let a, b be symmetric sequences and assume that c :~ a-k b exists. Then Ic exists, and if (la) -k b 
exists, then Ic ~ (la) *b — ((la) * &)q . 

The proof of this result is based on a careful rearrangement of terms justified by the repeated use of the existence 
of (la) * b. It is given in the appendix. 

We are now able to prove our main result on the VTF. 

Theorem 2. Let luh denote the VTF of a fractionally differenced process with H e (1/2, 1) and Cf chosen 
equal to ct. Then 

ujH{n) ^ uj*u{n) + D + o{l) 

where D ~ ~2 ^°^j^ j" |Gj | < Q is a constant. 

Proof. Since each of 7|^ -k G and uj*^ • G exist, Lemma[3]applies upon identifying a = 7!^, b ~ G and c = 7// 
and states that ujh = ^*h * G — {ujh * G}{0). >From Lemma|2]with b = G, Sq = J27L-oo ^j *^ '^^ exists. 
By introducing the term Sq^h ^^ obtain 



LUH = SgUJh + ( wjf * G - SgUJ*h j-{i^H-k G}(0) 

00 

= 5GC.|,+o(l)-2^r|G,| 

by the final part of Lemma|2] Since Sg = .9(0) = Cf /c} = 1> the result follows. D 

The key property underlying this result is ijj*jj -kG — Sglo*jj — > 0, which shows that G is 'compact' enough 
to act as an aggregate multiplier Sg asympotically. This is analogous to the role the covarian ce sum S^ — 



y^i^ 7(fc) plays in the asymptotic variance of aggregated short-range dependence processes iGefferth et al 



(2003). 



3.3 Atypicality and Speed of Convergence 

Theorem|2] showed that the VTF of a fractionally differenced process is asymptotically equal to the VTF of its 
fGn fixed point up to an additive constant. This makes fractionally differenced process highly atypical among 
LRD processes. We show this first for the VTF itself, and then for the speed of convergence of the CTF to the 
fixed point. 

Without loss of generality, the VTF of any time series in the domain of attraction of a given fGn can be 
expressed as 

iOH{n) = io}j{n) + iOd{n) (10) 

where tOd represents the distance of the VTF from its limiting fGn counterpart. By definition, ujdin) = o{n^^), 
but otherwise the growth rate of tud is not constrained, implying that there is considerable variety within the 
domain of attraction. 



One way of characterising the size of the difference ujd{n) is to use regular variation iBingham et al.l (Il987h : 
IGefferth et al. (2003(). A regularly varying function f{n) of index j3 and integer argument n S N+ satisfies 
limfe_>oo f{kn)/f{k) = n^, /3 G R. Assume without loss of generahty that cod is upper bounded by a regularly 
varying function of index /3 G [0, 2H], that is 

iJdin) = 0{s{n)n^), (11) 

where s is a slowly varying function (that is regularly varying with index 0), and /3 is the infimum of indices 
for which ( fTTT i holds. A notion of closeness of the process to the limiting fGn can then be defined in terms of 
/3, where the smaller the index, the closer the process. 

According to this scheme. Theorem |2] states that fractionally differenced processes belong in the closest layer 
of the hierarchy, corresponding to /? = 0. Furthermore, the theorem shows that s{n) (which could in general 
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diverge, for example s{n) ~ log(n)) tends to a constant. Thus, the VTF of a fractionally differenced process 
lies in a very tight neighbourhood indeed of the VTF of its limiting fixed point. Far from being typical LRD 
processes, they deviate only in very subtle ways from fGn in terms of their large lag behaviour 

>From (|2]i, there is a direct relationship between closeness in the above sense and speed of convergence of the 
CTF to its fixed point under aggregation. 

Theorem 3. Let (pu denote the CTF of a fractionally differenced process in the domain of attraction of (jf^ 
with H e (1/2, 1). Then 

(f>P{n) = 0^(7i) + Dil - n^^)m-^" + o{m-''^) = (/)J^(n) + 0{m-^") 

where D is the constant from Theorem^ 

Proof. The result follows from substituting ujH{n) = ^^in) + D + o(l) from Theorem|2]in ([2) and using 

{1 + x)-'^ = i~x + o{x^). n 

Beginning from ( fTOl i. it holds generally for LRD processes in the DoA of 0^ that cf)^' (n) — cf)^ (n) + 
0{s{m)m~^^^^). It follows that fractionally differenced processes, for which /? = and s{m) is identically 
equal to a constant, converge faster to the fixed point compared to all other processes in the DoA. Examples 
are provided in Section |5] 

4 Closeness of the ACVF 

Recall that lo = I7. Because the double sum operator I smooths out local variations. Theorem |2] can not be 
used to derive an explicit characterisation of the closeness in terms of the ACVF. We therefore set out to provide 
a closeness result for the ACVF here. Not only is this of interest in its own right, it also provides an alternative 
way of demonstrating the closeness to fGn, as well as leading to an additional result on the spectral closeness 
to fGn in an additive sense. 

The following lemma is the analogue of Lemma |2] used for the ACVF. A proof is given in the appendix. 

Lemma 4. Assume ~1 < a < Q and let a be the symmetric positive sequence a„ = |ri|", n y^ and oq > 0. 
Let b be a symmetric sequence with |6o| < 00 for which there exists /? g [0, 2] such that X)^i i^l^il < °° ^'^'^ 
\bn\ = 0{n~^°~'^^'). Then Sb '■= X]^-oo ^i '^^'^ ^''^ symmetric sequence c := a -kb exist, and c„ — Sba„ = 
0{n^^^) as n ^ 00. 

We can now prove the ACVF closeness result 

Theorem 4. Let jh denote the ACVF of a fractionally differenced process with H € (1/2, 1) and Cf chosen 
equal to cJ. Then 

Proof. The exact ACVF of a unit variance fGn(_ff ) is given by 

for n > and 7|j(n) == lH{-n) for n < 0. Then 7^^ (0) = 1, and for n 7^ inin) = {l/2)\n\'^"k{\n\-'^) 
where k{x) := (1 + x)^^ + (1 — x)^^ — 2. Expanding A: in a Taylor series around the origin, we obtain the 
following series representation: 



which is uniformly absolutely convergent since {«_,} is absolutely convergent by the ratio test. 
Now 7i/(n) == (7|f • G) {n) = Efcl-oo G{k) T.T=i Ci/j(" - k) = T.'jLi ^3 (fj * G) (ri) wh ere the existenc e 
of 7|f * G and 7^^ as absolutely convergent series justifies the interchange of summations JApostoll (119741) . 
Thm. 8.43). We can now compare 7^ and 7!^ as 



\lH{n)--i*H{n)\ 



Y,\cj\\{fj^G){n)-f,{n)\ 



j=i 



< |ci||(/i *G)(7i) - h{n)\ + Y. \c,\U^G){n)\ + 0(r 

i=2 



2H-A\ 



(12) 



(13) 



We shall show that each of the terms on the right hand side are of order 0{i'r'^^'^). 

The result for the first term follows immediately from Lemma|4]upon identifying /i with a, 2H — 2 with a, G 

with h with a choice of /3 = 2 (justified by Theorem[Tliii)), and noting that X]^-oo Gj = 1 by the assumption 

Cf = C*f. 

Now consider the second term. Recall from Theorem [T]that G„ = 0{n^^), i.e. there exists K > such that 
Gn < i^|n|~'^ for n sufficiently large. Thus, when j > 2 and for n > large enough 

00 00 00 

\{f,*G){n)\ = Yl mmGn-k\= Y \kr-''\G,,^,\< J2 \kr-'\Gr.-k\ 



k— — oo k— — OQ k 


——00 

k^O 






CX3 L"/2J CX3 

Y\kr-'\G,.^k\+Y.\>^\""''\Gn^>^\+ E \kr''\Gn-k\ 

k=l k=l k=ln/2\+l 


00 L"/2J 
k=l fc=l 


n 
2 


k=ln/2\+l 


00 L'i/2J 

KYikn + kY"-'+KY{kn-kY"-^ + 


n 
2 


2H- 


-4 





*;=! 



fe=l 



fc— — 00 



L"/2J 



< if^(fcn)2^-'* + A"^ (fcn/2) 
= 0(n 



2H-4 



^2H-i\ 



fc=l 



2H-4 



E |G. 



using 2H — 4 > —3, that kn + k'^ > kn for all k, kn—k^ > nk/2 for 1 < fc < n/2, the absolute summability 



of G, and the fact that J2T=i I^P^"'' < 00. Hence the right hand side of (O is 0(; 



,2_f/-4 



D 



In Section [3n we derived a result which may best be described as 'multiplicative closeness' for the spectrum 
of a fractionally differenced process. This form of closeness was natural for providing a subsequent link to 
the time domain. However, when calculations with the frequency domain are of specific interest, an additive 
closeness result for the spectrum is useful. Such a result can easily be derived from the above theorem. 

Corollary 2. It holds that /^(a;) = fni^) + vi^) where ip is differentiable, ip' G A^ if a < 2 — 2H, and 
(^(0) = 0. Moreover, ip{x) ~ 0{x~'^^+^) as x ^- 0. 



Proof. Let ip := fn — In- The Fourier series of ip exists and equals ip, and its coefficients are given by 
dn = lH{n) — 7|f (n), which by Theorem |4lis 0(\n\'^^~^). S i nce 2H — 4 < — 2 the first absolute moment 
of the coefficients exists, so Theorem 7.19 iKufner and Kadled ( 1197 ih . applies and shows that ip' exists and 
f' G A2-2ff. By the definition of g(0), ^(0) = lim^^o (/ff(a;) - /ff(x)//^(a;) /^(.x)) = 0. 

The last claim follows by straightforward expansion of /h(x) — fni^) about x = 0. Details are given in the 
appendix. D 
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Figure 2: The function (p{x) = Jh (x) — f^ (x) and its first derivative in the canonical case of a pure fractionally 
differenced process (FARIMAOdO) with H = 0.8 and Cf = cj. 



The additive closeness of the spectrum is a highly non-trivial result: from the usual spectrum definition of LRD 
(Section lZTI ). LRD with Hurst parameter H implies only that the ratio between Jh/Jh i^ bounded at the origin 
whereas the difference Jh — fn generally diverges. That the difference is not only a bounded function but 
tends to zero, and is also differentiable, emphasizes in yet another way how unusual fractionally differenced 
processes are among LRD processes. To explore this in more detail, observe that the statement of Corollary |2] 
can be written 

fH + V-= .f*H + ^+ 

where (p~ > and (p~^ > . Both ip'^ and ip^ define spectral densities with (p^{0) = 'Z' (0) — 0. We then 
(IBrockwell and DavisI (1199 ll) . Cor 4.3.1) obtain a probabilistic variant of the closeness result: a fractionally 
differenced process is equal in the distributional sense to its limiting fGn up to additive independent processes 
with spectra iy9+, <p~, both of which have the property of having a vanish ing covariance sum S ^ — J27L-oo 7j- 
Such processes (called Constrained Short Range Dependent (CSRD) in lGefferthet al.l (|2003[)), lie in the DoA 
of an fGn with Hurst parameter H' E [0, 1/2). In contrast, for Short Range Dependent (SRD) processes (those 
in the DoA of a fGn with H' = 1/2), S^ is finite but positive. A graph of a particular ip and its first derivative 
is shown in Figure |2] The plot suggests that ip^ = 0; whereby FARJMA would be equal in distribution to fGn 
plus an independent CSRD process. 

To conclude our treatment of the ACVF, observe that a slightly weaker form of the closeness result of Theorem|2] 
can be derived from Theorem^] Indeed, the identity LOnin) — i^H{n) ~ {Id)n implies 



\L.H{n)-Lo},in)\ = \Y,( Y, d,-J2dA <2J2 E \d,\<Oil)J2e"-^ = 0{l), 



fc=0 



] = -k 



k=0 j=k+l 



fc=0 



where we have used that d„ = 0{\n\^"-^) implies '£T=k+i MjI = ^(1) Ej°lfc+i J = 0{k^"-^). The 

0(1) remainder term simply corresponds to a bounded function; this is clearly somewhat weaker than the 
asymptotically constant remainder term appearing in Theorem|2] 

We recently became aware of Lieberman & Phillips (2008) iLieberman and PhillipsI (J2008|) which provides 
an asymptotic expansion for a class of fractionally differenced processes corresponding to ([3), though h{x) 
is required to be smooth rather than C^. Using the first two terms of this expansion and comparing 
wi th an expansion for 7^(771), it is possible to recover the 0{-n?^~''^) term of Theorem |4] The work 
of Lieberman and PhillipsI (120081) is focussed on numerical approximation through infinite-order asymptotic 
expansions and does not compare against fGn or draw conclusions on convergence speed or brittleness as we 
do here. 
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5 Fractional Processes are Brittle 

As pointed out at the end of Section |3] fractionally differenced processes converge 'almost immediately' to 
their fGn fixed point compared to other processes in the domain of attraction, and this is true in terms of each 
of the VTF, ACVF and spectrum. In this section we point out and illustrate a key consequence of this fact, 
namely the brittleness of fractionally differenced models. 

5.1 Brittleness 

Experimental data, especially data measured on a continuous scale, is very rarely clean. Imperfections in 
physical measurement are often treated through the concept of observation noise, modelled as a random process 
which perturbs the underlying observables. A very common choice is that of additive independent Gaussian 
noise, either white or coloured. In the present context, this corresponds to adding to the original VTF (or ACVF, 
or spectrum) the VTF (respectively ACVF, spectrum) of a short range dependent noise process, that is a noise 
whose own fGn fixed point has H' = 1/2. 

As argued at the end of the previous section, we can essentially think of a fractionally differenced process as 
an fGn to which a CSRD process has been added. Adding an SRD noise to this will change the asymptotic 
behaviour, because the SRD asymptotics (with S*^ > 0) is 'stronger' than CSRD asymptotics (with S^ = 0). 
In terms of the hierarchy within the DoA described by the index f3 from (fTTT i. whereas the original process lies 
very close to the centre with /3 = 0, the SRD-perturbed process will lie considerably further out, with /? = 1. A 
similar observation can be made if we instead add a noise with LRD with H' < H (resulting in /3 G (1, 2H)), 
or even another CSRD process with H' > (resulting in /3 G (0, 1)). This last result follows from the fact that 
Theorem|2]implies that the 'error' processes are so special that they are not only CSRD, but correspond to the 
extreme case of H' = 0, resulting in /3 = 0. 

Since the addition of even trace amounts of noise of diverse kinds will change the asymptotics, pushing the 
process further from its fGn limit and therefore slowing its convergence rate to it under aggregration, fractional 
differencing models are 'brittle' or non-robust in this sense. Properties of systems driven by such processes 
may therefore differ qualitatively from properties of the same system once noise is added. The precise impact 
of the noise is beyond the scope of this paper (see the discussion). It will depend on both the application and 
the class of noise and must be determined case by case. 

5.2 Numerical Illustrations 

In this section we illustrate the brittle nature of fractionally differenced processes through high accuracy 
numerical evaluation of the VTF of FARIMA time series, both with and without additive noise. 

Three different examples will be considered, two with SRD-noise and one with LRD-noise. More precisely, 
the perturbed processes are Zi{t) = Xi{t) + \/Q.lYi{t) for i = 1,2, 3, where 

1) Xi: unit variance FARIMA(0, 0.3,0); 
Yi : unit variance Gaussian white noise, 

2) X2: unit variance FARIMA(1, 0.3, 1) with ARMA parameters (^1, 6*1) = (0.3, 0.7); 

Y2: unit variance ARMA(1, 1) process also with ARMA parameters {(l>i,9i) = (0.3, 0.7), 

3) X3: unit variance FARIMA(0, 0.3,0); 
Y3: unit variance FARIMA(0, 0.2, 0). 

In each case, the original process Xi and the perturbed process Zi share a common fGn fixed point, but have 
unequal variances. It may seem unfair to compare results for processes with different variances, however the 
opposite is true. In fact, if the variances of Zi and Xi were chosen equal, this would mean that c/ 7^ cJ, and 
so their fGn limits would be different, rendering meaningful comparison impossible. To see this more directly, 
from the definitions in Section lSTl it is clear that adding a perturbation corresponding to a smaller H value does 
not alter the fixed point. On the other hand the variance must increase when an independent noise is added. 
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Figure 3: Ratios of VTF's of original FARIMA and perturbed processes to their fGn limit, both originally 
and under aggregation, one column per example. The solid circles denote unperturbed FARIMA; the hollow 
circles the perturbed ones. It is seen that the VTF's for unperturbed FARIMA converge much faster than their 
perturbed counterparts. 

For each example i — 1, 2, 3, we calculate the VTF of Zi and Xi and normalise them by dividing by their 
common fGn limit a;|j. Closeness to fGn can therefore be evaluated by looking to see how the normalised VTF 
deviates from 1 for each lag. Maple version 13 was used to numerically evaluate the variance time functions to 
a high degree of precision. 

Figure [3] displays the normalised VTFs for lags 1-10 for aggregation levels m = 1, 10, and 100, with one 
example per column. The graphs clearly demonstrate that even a small departure from FARIMA takes the 
process much further away from its corresponding fGn. Indeed, after an aggregation of level 100, in each case 
the VTF of the original process is visually indistinguishable from its fGn limits compared to their perturbed 
versions. 

Note that the second column in the figure gives an example where before aggregation (m = 1) the perturbed 
process was in fact closer to the fixed point over the first few lags, where most of the obvious autocovariance 
lies. Under aggregation however, this quickly reverses as the different asymptotic behaviours of the original 
and perturbed processes manifest and become dominant at all lags. 
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6 Discussion 

We have shown that fractionally differenced processes have an asymptotic autocovariance structure which is 
extremely close to that of the fractional Gaussian noise, more specifically, to that of the fGn fixed point to 
which the given process wiU tend under aggregation based renormalisation. We have shown this independently 
for each of three equivalent views of the autocovariance structure, namely behaviour of the spectral density at 
the origin, and each of the autocovariance function and the variance time function in the large lag limit. 

We showed that the natural class of processes against which this behaviour should be compared are those in 
the domain of attraction of the fGn fixed point limit. Using regular variation to provide a measure of distance 
from this fixed point within the DoA, we were able to precisely quantify the nature of this 'closeness', and 
to confirm that the fractionally differenced class are indeed exceptionally unusual in this regard, resulting in 
very fast convergence to fGn under renomalisation. We then used this fact to point out that the fractionally 
differenced process class is brittle, that is, non robust to the presence of noise. In particular we showed that the 
addition of arbitrarily small amounts of independent noise, not only Gaussian white noise but also noises which 
are much gentler in a precise sense, changes the asymptotic covariance structure qualitatively. This fact has 
not been appreciated in the literature where such models, for example the FARIMA class, are widely used in 
time series modelling, synthetic data generation, and to drive more complex stochastic systems such as queuing 
systems, without regard to robustness with respect to the model in this sense. 

The assessment of the impact of the brittleness of fractionally differenced models is beyond the scope of 
this work, as it will depend intimately on each particular application as well as the nature of the noise in 
question. However, we argue that conclusions based on the perception that FARIMA and related models 
represent 'typical' LRD behaviour need to be reassessed, in particular in contexts where noise is important to 
consider. To give an example of a possible impact in the noiseless case, we conclude by expanding upon the 
comments given in the introduction on statistical estimation. 

The closeness of a process to its fGn fixed point in functional terms is directly related to the speed of 
convergence of that process to the fixed point under aggregation. One application where this fact carries 
direct implications is the performance of statistical estimators for the Hurst parameter H. Fundamentally, 
semi-parametric estimators of scaling parameters such as H are based on underlying estim a tes made at a set o f 



'aggregations' at different levels, that is at multiple scales lRobinsonl(ll994l) : lBeranl(ll994l) : lAbrv et al.l (119981) : 
[Taqquetal. (1995). The sophistication of particular estimators notwithstanding, this is true regardless of 
whether they are based in the spectral, time, or wavelet domains, though the technical details vary considerably. 
In the time domain using time domain aggregation the link is of course direct, and reduces to looking at the 
asymptotically power-law nature of V'™-' = w^™) (0) as a function of m in some form. This is precisely where 
fractionally differenced processes are at a real advantage, as this quantity converges extremely quickly to that 
of the fGn fixed point, whose ideal power-law behaviour V^™' ~ Vtv?^ allows H to be easily recovered. 
As a result, estimator performance evaluated through the use of fractionally differenced models would be 
superior to that for LRD processes more generally. Note that we are not recommending that H es timation be 



perfor med directly in the time domain by regressing V^™) on m, indeed we have argued the opposite lAbrv et al. 



(Il998h . Our point is that the extreme closeness of such models to fGn must ultimately manifest in simpler 
asymptotic behaviour which will, in general, translate to improved estimation. Indeed, in the spectral domain, 
the importance of t he degree of smoothn ess at the origin for the ultimate limits on estimator performance has 



already been noted iGiraitis et al.l (119971) . Note that the above observations in no way put into question the 



findings of prior work on estimation of fractional processes in noise. 



7 Appendix 

The appendix is split according to results relating to spectral closeness (Section 13.1b . closeness of the VTF 
(Section[32]i, and of the AC VF (Section|4]i. For convenience, the statement of results proved here are generally 
repeated. Lemmas Al and A2 are labelled separately as they appear in the appendix only. 
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7.1 Spectrum 

Details of the proof of Theorem [T] 

(i) It is well known, and can be verified by examining (|4]i and (|5j, that each of f'^ix) and fnix) diverge 
to infinity at a; = but are otherwise even, positive and continuous. Since g(0) > is finite, g is positive 
and continuous on the compact domain and hence bounded, and even. Since g is continuous, it is integrable 
dChampene v ( 1990 ), p. 9), and since, forp > 0, g^ is likewise continuous, positive and bounded, g is in L^. 

(ii) Since a{x) > 0, ^ is bounded away from zero. Each of a, h, and c are smooth. The latter follows from the 
fact that for each j ^ Otheterm |7rj+7rx|^(^^"'"^) is infinitely differentiable in .t G [—1/2, 1/2]. By comparing 
against X]?li (i ~ 1/2)^^^^+^' < oo the Weierstrass' A/-test shows that the defining sum for c, and the sum of 
the ter m by term first derivatives, each converge uniformly. A classical result on the differentiability of infinite 
series (lApostoll ( 119741) . Thm. 9.14) then shows that c' is given by the latter sum. Using exactly the same A/-test, 
this can be repeated for derivatives of all orders, proving that c is smooth. 

Since a is smooth and bounded above zero, |ap^+^ is smooth over [—1/2, 1/2], and the same is true for 
|^|2ff +1 ^yy^y from the origin. It follows that g is smooth everywhere except at the origin where its smoothness 
is controlled by that of |5|^^+^ 

7.2 VTF 

Lemma 1. The auto-covariance functions jh o.nd 7|f are related through the convolution ^h = G * 7|f . 

Proof. Therh.s. exists since j:T=-oo Gjlhin-j) < E.'l-oo |G,I|7^("- j)l < 7iV(0) E,°l-oo |G,I < cx) 
from Theorem[T] For the l.h.s. we can write 



1/2 1-1/2 

e2'^""da; (14) 

/2 J-1/2 

111 oo 



lH{n) = / '/^(x)e2-'-"dx= / g{x)f*H{x) 

J-l/2 J-1/2 

= / (J2 Gje-2^*^n/^(2;)e2"™dx (15) 

^1/2 j = -oo 



as the Fourier series for g{x) converges absolutely for all x since J27^-oo l^jl < '^ (Theorem[T). Now 

/1/2 oo oo „i/2 

( V \Gje~^''"^)f^{x)e^''""dx = V \Gj\ / /|f(a;) e^"^" dx 

oo 

= ihin) Y. \G,\ <^. 
i=-oo 



This justifies the use of Fubini's Theorem (ITavlod (Il973h . Th.6.5) on the iterated integral (fTSl l to reverse the 
order of integration and summation. Using the evenness of G and f^, this yields 

.1/2 



7H{n) = y^ Gj / /^(x) cos(27rxj) cos(27rxn)dx 

, = -oo ^-1/2 

= 2_, Gj / /|f(a;)-( cos(27rx(j — n)) + cos(27ra;(j + ?i) j da; 

j = -oo "'-1/2 

^ OO ^ oo oo 

= 2^ G,(7H(.7-n)+7H(j+n)) = -( ^ G,7H(n-j)+ ^^ G.^^i-j ^ n) 

J — — 00 J — — 00 J— — 00 

= ^ ( (G * 7lf)H + (G * 7lf )(-")) =(G*7lf)W, 
using the evenness of ^^ and G * 7^^ , and the existence of G * 7^^ to justify the splitting of the sum. D 
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Lemma 2. Assume 1 < a < 2 and let a — {\n\°' : n G Z}. Let b be a symmetric sequence satisfying 
^- -^ j"|5j| < oo. Then Sb = 'Y^,_^bj and the symmetric sequence c = a-kbexist, and^Cn — ShCLn) ^ 0. 

Proof. Since a > 1, X]?!L-oo \^j\ — l^o| + '^J27LiJ°'\bj\ < oo, so 6 is absolutely summable and hence 
summable. Now consider c. Clearly cq ~ J27L-od I ~ il"^j exists by the assumptions on b, and for n > 

— n n— 1 oo 

ic„i = i(a*6)„i < Y. \^-jnb,\+ E I'^-jti^.i+EI"-^'!"!^^-! 

oo 71—1 OO 

< E(2^Ti&.i+ E i^-jri&,i + Ej"i^^i<«^- 

j=n j=-n+l j=n 

Since both a and b are symmetric, c„ also exists for n < 0, and so c exists and is symmetric. 
For the last part, since c„ — Shan is symmetric in n we assume n > and rewrite it as 

oo oo oo oo oo oo 

J2 \n~jrb,-n^ J2 b,=n^b, + Y,{n + jrb,+Y,\n~jrb,-n^ ^ &.=E^"^^ 

j=-oo i=-oo j = l j = l j = -oo j=l 

where T^ := |n - j|" + (n + j)" - 2n", n > 0, j > 0. Noticing that T^ = fa{n,j) from Lemma Al, we 
have that T,| < Tq — 2j" for each fixed j, and so 



AT CO AT 






Now given any e > 0, a N{e) > 1 can be found such that J27Ln+i ^"l^j I < s/4- Next, since T!;^ — > for 



AT 



any fixed j (Lemma Al below), there exists an no{N) such that J2i=i l^nl l^j I < ^/^ when n > uq. It follows 



n—^oo 



that |c„ — S'bflnl < e for 71 > no and so (d — Stan) — > 0. D 

Lemma Al Assutne 1 < a < 2 and define fa{x,y) := \x — yl" + {x + y)°' — 2x°' for a; > 0, y > 0. For each 
y> fa{',y) is positive, strictly decreasing, and lim^^-i-oo fa{x,y) = 0. 

Proof. Fix y > 0. We split the domain of /„( • , y) into two cases. 

Let X > y. It follows that fa{- ,y) = ctfa-i{ ■ ,y)- Define 17(0;) = x". Since g'{x) = ax""'^ is strictly 
concave, [x — y)"^^ + (x + y)"^^ < 2x°'~^ and so /4( ■ ,y) < and /□,( • , y) is strictly decreasing. To prove 
lim^^oo fa{x, y) = 0, we apply the mean value theorem twice to g, and then once to g', to obtain: 

f„{x,y) = {{x + yr - x^) - {x'' - {x ^ yr) (16) 

< ay{ix + yr-'-{x-yr-') (17) 

< 2aia~l)y^ix~yr~^ (18) 

(since 5' is strictly increasing and g" strictly decreasing), which tends to zero as a; — > 00. 
Let a; < y. In this case, the derivative with respect to x yields 

/;(x,y) = a{{x + yr-' - (y - xr-' - 2x"-') (19) 

< a((x + y)"-i-(y-x-)"-i-(2x)"-i) (20) 

= a{h,iy) - h^ix)) (21) 

where hx{y) = (a; + y)"^^ — (y — a;)"^^. Since the derivative of h^ is negative for x > 0, h^ is strictly 

decreasing. It follows that /4(-, y) < and so /„( • , y) is likewise strictly decreasing. 

Finally, since fa{x, y) is decreasing for all a; > and tends to zero, it is positive. D 
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Lemma 3. Let a, b be symmetric sequences and assume that c :~ a-k b exists. Then Ic exists, and if (la) -k b 
exists, then Ic ~ (la) *b — ((la) * b)^ . 

Proof. Since (Ic)„ is a finite sum of elements of c, it exists for each n. Now 

n — 1 k oo 

(ic)„ = Y.J2J2 "-j^^-i 

k—Q i— — k J — — 00 

can be rewritten as (Ic)^ = S^-oo ^j^n{j) where Hn{j) := Xll-^o Sz^-fc ^2-i' since a finite sum of 
convergent series is convergent. Since (Ia)j_i — 2(Ia)j + (Ia)j+i = a-j + a^- = 2aj, we have 

oo ^ oo 

(Ic)„= ^ a,iJ„(j) = 2 E ((Ia),-i-2(Ia), + (Ia),+i)i7„(.7) (22) 

j — — OO j ^ — OO 

-J / oo oo oo \ 

= 2 E(I°)^-i^"(j)-2E (I«)^^«(-?)+E(I«)j+i^"(j) (23) 

-. oo 

= - E (I«)j (^«(J + 1) - 2i^«(j) + ffn(j - 1)) , (24) 

Step ( l23b is justified since each of the sums is convergent, because each can be written as a finite sum of series 



of the form X]?l-oo(-'-'^)i ^m-i for some m, and this is just ((la) * 6),„ which exists by assumption. Now 



7J„(j + 1) - 2i/„(j) + H„(j - 1) = (i?„(j - 1) - H„(j)) - (i/„(j) - H„(j + 1)) (25) 

= E ( E ^^- E ^0-( E ^'- E M (26) 



fc— \ i— — A;— j + l i— — k—j i— — k—j i— — k—j — l 

n-1 



E (^'^-.+1 - ^-fe-.) - {bk-, - &-;.-,-i) (27) 



71—1 71—1 

= E (^''^-J+i - ^^-^) - E (^-''^-^ - b-k-,^i) (28) 

fc=0 fc=0 

= (bn-j-b-j)-{b-j-b^n-j)=bn-j+b-n-j-2b^j. (29) 

The resuh then follows by substitution into (l24l i. using the existence of (la) • b to justify splitting the sum, and 
finally by the symmetry of (la) and b. D 

7.3 ACVF 

Lemma 4. Assume —1 < a < and let a be the symmetric positive sequence an = \n\"', n j^ and ap > 0. 
Let b be a symmetric sequence with |&o| < oo for which there exists /3 £ [0, 2] such that X]^i i l^il < 0° ^'^^ 



\bn\ — 0{n f'^"*'^-'). Then Sb := X]?!L-oo ^j '^''"^ ^^^ symmetric sequence c := a -k b exist, and c„ — Sba„ 
0{n°'^^) as n ^ oo. 



Proof. Wehave^°^_j^ \bj\ < bo + 2jy^i j^\bj\ < oo so 6 is absolutely summable and therefore summable. 
Then ^b exists. Moreover, \cn\ = |(a*6)„| < J^JL-oal^jW'^ri-jl < \bn\ao + J2jL-ao\^j\ < °°- We 
conclude that c„ exists for each n € Z, and that c is symmetric by the symmetry of a and b. Define T^ := 
a|„_j| + a„+j — 2a„, and using the symmetry of a and b rewrite c„ — SbUn as: 

CXD OC OO 

(a Tk: fe)„ - SbQn = a„&o + E "l"-il^J + E ""+i^J ^ "^fc"" = E "^"^-J' ^^^^ 
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To prove the last part of the theorem it suffices to consider n >0, since c is symmetric, and as we are interested 
in large 77, asymptotics, we restrict to n > 2. The sum for |c„ — SbCinl can be decomposed as 

[n/2\ 2n oo 

\cn - Sta„\ < ^ |T,i||6,| + J2 \^nm + E \^n\\b,\ =: A„ + B„ + C„. (31) 

J = l j=Ln/2j+l j=2n+l 

We shall show that each of A„, i?„, and C„ are of order 0(n"~^). 

The definition of A„ implies n > j > 0, so Lemma A2 below applies to Tl ~ fa{n,j), and implies the 
existence of a constant A' > such that |T^| < Kj'^{n ~ j)"~^ < K j'^ {n / 2)°'~'^ when j < n/2. Thus 

L"/2J L"/2J 00 

A'-i2"-2A„ < n"-2 ■^ j2-V|6^.| < n'^-^n^-P ^ /|6^-| < n"-^^/|6,| = 0(n"-'5). (32) 

For B„, where n y^ j and n, j > 0, we have |T^| < 2|ri - j|", while |r,7| = oq + (2" - 2)a„ = 0(1). Then 
for sufficiently large n, by assumption there exists a A' > such that 

n— 1 2n 

Bn < 2 Y. ("-Jn6,l+2 ^ 0--<|6,|+|r:||6„| 

J=L"/2J+1 j=ri+l 

— fi3+l1 / "^"'" ^" 



< 2^+3i^n-('3+i)Er + 0(r 



-(/3+l)^ 



i=i 



< 2'^+3/fn-('3+i) (1 + / x"dx) + 0(?i-('3+i)) = 0(n"-^). 

For C„, where j > 2n, we have Tl < 2n". Since Ejl2n+i l^jl < (2n)-'3 'ET=2n+i.f\h\ = o{n-^), we 
get 

Cn< J2 2n"|5j|<2n" ^ h\=o{n''-^). (33) 

j=2ti+1 j=2ri+l 

Conclude that |c„ — 56a„| = 0{n°'^^) as n -> cx). D 

Lemma A2 Ai^Mme a < and define fa(x,y) :~ \x — y\" + {x + y)°' — 2x°' for x > y > 0. Then fa{x, y) 
is positive and obeys /q(x, y) < 2a{a — l)y'^{x — y)"^^. 

Proof. Since a; > y it follows that /4( •, j/) = afa-i{- ,y)- Define 5(2;) = x". Since (/'(a;) = ax°'~^ 
is strictly concave, a{x — y)"~^ + a{x + y)"^^ < 2ax"^^ and so /4( • , y) < and fa{- ,y) is strictly 
decreasing. Now apply the mean value theorem twice to g, and then once to g', to obtain: 

/„(x,y) = {{x + yr - x") - {x^ - {x - yr) 

< ay((a;-y)"-i-(x + y)"-i) 

< 2a(a-l)y2(a,-y)"-2. 

since g' is strictly increasing and g" strictly decreasing. D 

Details of the proof of Corollary |2] We explain here why ip{x) = fnix) — fnix) = 0{x^'^^^^) as a; ^- 0. 
Calculate the first few derivatives of the analytic function x 1— >■ (sin(a;)/x)^^^+^ (set to 1 at x = 0) and 
expand in a Taylor series around the origin to find that (sin(a;)/a;)~^^+^ = 1 + 0{x'^). It follows that 
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sin(a;) ^H+i — 3, 2-ff+i _|_ q(^j, 2H+3^ f^j. j; ^ q. The function h is assumed three times (continuously) 
differentiable. Symmetry impUes h'{0) = so that by Taylors theorem, h{x) = h{Q) + 0{x'^). Thus 

h{x) sin(7rx)-2^+i = /i(0)^-2H+i^-2H+i ^ oix-^"+'), x^O, 
while it can be shown that 

(1 - cos(27rx))x-2«-i = 2^2^-2H+i ^ o(a;-2^+3), x ^ 0, 
and 

oc 

(1 - cos(27rx)) ^ |7rj + 7ra;r2if-i ^0(2,2-)_ 



J — — 00 

3^0 



Then 



fHix)-rHix) = {/^(x)(2siIl(7^x))-2^+l} 

- {h{0)2-^"7r-''"-Hl - cos{2Trx))x~^"-'} + Oix^) 
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